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BACKGROUND 



The Bilingual Education Program -vas established in 1968 to demonstrate 
ways of meeting the special educational needs of students of limited 
English-speaking ability. A major goal of the program is to- show how 
children can progress in school, using their native language while 
acquiring competence in the English language. Authorized by Title VII 
~of--the Elementary and Secondary Education Act^ (ESEA) 6% 1965, ^s amended, 
..the program~~prpvide5^ f-undal^ agencies for the development 
and implementation of bilingual e^catTon "projects..^ 
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Educators and noneducators alike hdve shown a growing awareness of the-^-^\^ 
lack of — and , heed for^— evidence regarding the ef f-ectiveness of • 
bilingual education programs.. In 1974, the U.S. ^ Office of Education/Office 
of Planning, Budgeting, and Evaluation contracted with the American 
Institutes for ile search of Palo Alto, California to conduct a study of 
the effecti%?eness of federally funded bilingual education projects. Up to 
that time, no large-scale national evaluation of the ef f ec-^tiveness^of the 
Title VII Program had been conducted. 

Bilingual education projects selected for evaluation .were all Title VII 
Spanish/English bilingual projects in either- their fourth or fifth year 
. of folding as of fall 1975. Projects such as these weie thought to be 
reasonably mature projects — ones having refined their approach to 
bilingual education over time. (The variety of languages used in the 
other projects and the problems of developj^g testing in'truments for^ 
these languages led to the decision to limit the present study to 
Sf^anish/English bilingual projects, which comprise the majority 'of all 
bilingual projects. ^ - 

The objectives of the study were: 

' (a) to oetermine both the cognitive and affective impact of 

bilingual education on students in Spanish/English bijingual . 
educationc^-isjrojects fu^ided through ESEA Title VII; 

(b) to, describe the educational processes operating in these 
projects; ' 

(c) 



to identify those educational practices which result in greater 
gains In student achievement^ 

to determine per student costs associated with each project. 

This Executive Summary describes interim results ,of the Study; final 
results will be available in the fall of 1977. » 



(d) 



-2- 



METHODOLOGY , 

The general desigc of tfhe Impact Study was one of contrasting the 
performance of two groups of' students: those enrolled in^ Title VII 
Spanish/English bilingual projects and comparable studen1;s -not enrolled \. 
in such projects. Students from grades 2 through 6 w*er^ pretested in 
fall 1975 and posttested in spring 1976. The characteristics of jSrojects 
in operation were documented thoroughly for' a subsample of aU classrjjoms ^ 
of studetits involved in the Study, The Title VII group of students . 
consisted of approxiinately 5300 students, in 286 classrooms , in 117 
schools, in 38 projects. The non-Title VII group of students (comparable 
students) consisted \5f approxima-tely 2400 students, in 115 classrooms, 
in 50 schools. \ , v. ' ^ \ 

-IdAIA.. COLLECTION ^ * ' ■ 

Standardized achievement tests were uVed td measurelst^^^ achievement^ 

in English Language Arts (Reading and Vocabulary) , Mathematics-Computation. 

(two versions of tes-t, one in English and one in Spanish), and Spanish 
Language Arts (Reading).' In addition, information was collected via a ■ . 

■ Student Questionnaire (two versions of questionnaire, one in English and 
one in Spanish) about student background factors and student attitude 
tovard school-related activities. To assess ^teacher characteristics and ^ 
attitudes toward bilingual education, a teaclier/aide questionnaire was 

^ developed. To document the educational experiences of subsets of students 
in the sample, interviews were conducted with personnel at those sites _ 
select§i4 and classrooms were observed. ' ,f 

Each student was assigned a testings package containing tests, afjpropriate 
to thfelr level of language competence as judged by the' classroom teacher: 
English-dominant, Spanish-dominant, bilingual 'Spanish-domlnaht, Bilingual . 
English-dominant. All students were administered the' English Language 
Arts tests. The testing sessions were conducted in the late fall and 
late spring of the 1975-76 school year. 

THE SAMPLE 

Students participating ifi each of the 38 Spanish/English bilingual projects 
in their fourth or fifth year of funding (as of. fall 197^) were tested. 
Within each project, af least one classroom was randomly' selected for 
testing from each grade level 2 through 6. -o tUe extent that paiJticipating 
projects would agree ±0 additional testing," additional classrooms of students 

■ were randomly selected for testing. Not every grade at every school was 
tested; however^ for a given project, all grades were represented. The 

' result was that approximately AO to. 50 per cent pf all classrooms within 
each project were tested. ^/ 

For each Title VII classroom selected for testing, project personnel were 
asked to^ominate non-Title VII classrooms (comparable students) within 

■ or nearl^5\^eir district whose students matched the Title VII students in 



terms of (a) ethnicity, CtX socioeconomic status, and (c) grade level 
Where there was moVe than on^ potential "match/' a random selection was* 
made tt> delect .the non-Title VII classroom to be included In- the Impact 
Study.. However, JL8 p^oject$« wete not atsle to nominate comparable non- • 
Title VII .classrooms. -The non-Title Vll/students were- roughly comparable ''^ 
to the Title, vtl students ,^ with the one exception that"more non-Title VII . 
students than Title VII s'/udents were citified By their teachers as either 
English-dominant or bilingual English-jiominant — 9^ per cent as* compa-red ^ 
t.o 75 per cent. (See. footnote 1.) ' 



DATA ANALYSIS PROCEDURES . - ^ . 

Twp data analysis procedures were usec^ to assess' the overall effectiveness 
ofthe Title VII Spanish/English bilingual projects. One, posttest scores 
of Title Vli -students..*— a'cijusted statistically fot differences between 
groups on pretest score and socioeconomic status — were contrasted with 
those of non-Title VII stu4ents for each grade 2 through 6. Two, the 
achievement, levels of Title VII and non-Title VII students "we're contrasted 
with national norjns whenever such norms were available f<r the achievement 
test" used. 



Q. 



FINDINGS ' ^ 

' JiPcidit kinds of students were t^articipating in the Title VII projects? 

o Approximately 75 per cent of the students enrolled in the Title 
' . • ^VII Spani-sh/.English bilingual classrooms were of Hispanic origin, 

' V ' o However, less than one-thitd <3f the students enrolled in the Tftle 
VII classVooms in grades 2 through 6 were of Ifmited. English- 
speaking ability, ' . ' ^ , - . 

Hov^■e:cperienced were the Title VII teachers and aides' : in bilingual 
education? - ' " * ' - 

•o Almost all the teachers and most o? "the aides had been involved 
with inservice or district workshops in bilingual education and 
had taken coiirse work in bilingual education. 

o 'Two-thirds of the teachers and two-thirds of thi aides had two 
or ''more years of teaching e2tperience i''n bilingual education 
classroous . . 

o Approximately two-thirds of the teachers and*,almost all of the 
aides indicated that they spoke both English and Spanish in 
their homes. ' >!, " , 

iThe final rfeport will contain the results of various, analyses which will 
- attempt to statistically eliminate this difference between Title VII and 
non-Title^ Vtl 'students.. / . 
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I^at wer^ some general characteristic^ of the Titla VII projects? 

o tU number of students served by' a Title'' VII pro;1ect ranged 

fiom 200 to 5000, with approximately half of the projects 
/:..s.nrving b'etween 200 and 500 students each. 

o ' Project ma'nagement was generally stable over the 4 or- 5 years 
of operation. Ten per cent of the projects had more than two • 
ptoject directors; about half had two directors; and ,, one- third 
■ iiad the same director since the project's inception. 

q ■ ■ 'V, 

o Although the intent of the. ESEA litre VII legislation is to 
focus upon students- of limited English-speaking ability, 
» ' • approximately 85 per cent of the project directors indicated 

that Spanish-dominant students remain in the bilingual project 
once they ate able to functic.o i.V -^qhool ,in. E.iglish. • Only 5 per 
cent of the project directors indicated that a student i's ^ 
transferred to a a English-only classroom "once the student learns 
English .well enough to function in school. . ' £■ - . ■ 

. *. - 

o ^For $tudenti enrolled ih°the Title VII .prpj ects,. per pupil ^ 
expendti:ures from Title VII funds ranged from $150 to $739 with 
an .average of $310; district expenditures -ranged from $680 to 
$1243 with an averag? of $915; funds for bilingual education from 
State and/or Federal sources, ranged from $18 to $71 with a;i average 
of" $44;>and, funds from other sources (Federal and-State, but not 

l-_J3j.lingual) ranged from $0 to $271 with an average of $174. Con-. 

sid^i5g~St^]^ourceslofJunds, the per pupil cost for Olitle VII 
students ranged from $112T-1:lr-$21^0-with.an_av^^ oi $1398. (The 
grand total per per cost for non-Title VII studenl^-r-anged_irom__^ 
$992 to. $1534 with an average of $1022.) ' - „ 



What was the impact of Title VII projec ts -on student Achievement and 



attitude' to ward schpol. ? 

vl i 



Although the exact percentiles vary among grades, both Title VII - 
and non-Title VII students were achieving in English Language Arts 
at approxiiTAtsly the 20th percentile, relative to the national norm 
bpth vJhen tested in the wll and in tl^e spring. (See footnote 2.) 



^The Comprehensive- Test of Basic- Skills was .used to measure student ' • 

achievement in English Language Arts and Mathematics computation. Although 
the norm table for results obtained at the end of the ^school „year is 
empirically ba«ed, the norm table for the beginning of the school year is 
based oh estimated student achievment. A more accurate estimation 
(in progress) of the norms for the beginning of #ie school year may slightly 

• .alter these results. The results of these analyses will appear in the 
final report. • « , . - . 
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o Son-TitU VII Hispanic students outperformed Title VII students 
" o^/n "4 Sn"gie^e Arts/ The two 1^^^^^^^ 

corrections were made tor ^airrereucea wuj-x. ««««T^^^e 
' there were large differences in language dominance, ^he non-Title 
■ J^I group bS more English-dominant, and adjustments have not yet 
. Sen'^de. for these differences. . Therefore'. ^.^^^^^^^^^^ 
performance between the -two groups may be ^^//^^Viot" 
participation in the program or by language dominance or by both 
fartors! Bo?h groups generrlly either maintained or improved 

. ■ their p;r.certil! ranks'but it is possible that further, more 
refined, apalysis will lessen these .positive effects. 

o Title VII Hispanic students generally performed better than 
non-?itle VII Hispanic students. with regard to Mathematics 
. C°o::p^taiio. HowLer. both ..roups generally either main^^ 
. ; or improved their percentile rank (approximately 30) from pre 
test to pbsttest. . • ^ • 

o For Title VII Hispanic students, posttest achievement in Spanish 

^ "fltt^te"-^^^^^^^^^ 

o Participation in a Title VII project did not aftect attitudes 
toward school-related, activities. 

SUMMARY ; ■ .. . ' " ^ ^ . 

-^Se^vaWtlOn of the'lSEA Title VII JP"if g^^f ^'^^^J^) of ltSnts 
■ indlcIiir^SF^elatlvel^ snu>ll nuBber a^^^^ 

• r.5i«is riiK^^^ii^fj^K^^-^"^^^ 

evaluation indicates that: ^ • - , 

:• - "uld'^re been%ectedl2 the absence of .program. .. 

(b). The results on English -ading and «cah»lary test^ 

■ . ■ 'fdrntrS Vtn% n a™ 'uiiuy^e'f ormed poorer than 

' Students in iic±e. vxx cxaooi-^, ^«<r.-.T^ ^^ a VTT students 

. non-Title VII students. the Title nt ' 

- - , group .ere more fJ^.^.^^;trSr4^:t1:r"S: of. the' 
fefult" lo^ gfoipsleiSlny either maintained "or Improved 
their percentile ranks from pretest to posttest. _ 



(c) "Achievement gains in Spanish Language ArAs by Title Vll ' 
Hispanic students were observed but could not be attributed 
solely to participation in the bilingual eduilati(?li program. 

One difficult problem vith any evaluation of program impact is estimating 
what studeitt performance would haVe been in the absence of that program. 
Furthe- refinements of such estimates will bp presented in the final report 
and may slightly alter the findings presented at this time, but no nj^jor 
differences are expected.. 



